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(54) Electronic still camera 

(57) An image pickup device is operable in a thin- 
ning mode, and an image pickup signal is supplied to a 
liquid crystal display and the image is displayed (mon- 
itoring mode). The image pickup device is operable in a 
progressive scan reading mode, and the image pickup 
signal is written into a DRAM (first recording mode). Af- 
ter completion of writing to the DRAM, data compressed 
by an encoder/decoder is written into a flash memory 



and the image pickup signal is displayed (second re- 
cording mode). The image pickup signal is read out from 
the flash memory, decoded and written into the DRAM, 
and the image pickup signal is displayed (first reproduc- 
ing mode). The data is thinned and read out from the 
DRAM and displayed (second reproducing mode). 
Switching operation of the various modes is controlled 
by a data switcher and a microcomputer 
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Description 

The invention relates generally to image pickup systems, and can be applied to an image pickup apparatus, and 
a solid state image pickup device thereof, for use in an electronic still camera for example. 

5 Recently, the electronic still camera is being spread. As a solid state image pickup device, for example, a CCD 

whicfi is suitable for use in the electronic still camera, a device of a square lattice and a device of a progressive scan 
have been proposed. According to the square lattice, an interval in the vertical direction of adjacent pixels and an 
interval in the lateral direction are equalized and it is used to match an image pickup signal with a signal for a monitor 
for a personal computer. According to a CCD which is used in a previously proposed video camera or the like, in order 

10 to generate an output signal of an interlace type, as shown in Fig. 28, charges are accumulated for 1/60 second (one 
field), the charges of pixels of upper and lower two adjacent lines are read out, the charges of the two pixels which 
were read out are mixed in a CCD for vertical transfer, a combination in the vertical direction of the two pixels to be 
mixed is deviated with respect to an odd field and an even field, thereby realizing an interlace scan. 

According to such a CCD, since an accumulating time is equal to 1/60 second, as compared with a frame accu- 

is mulation type of an accumulating time of 1/30 second, an image pickup of a motion image can be preferably performed 
but there is a disadvantage such that a vertical resolution is low. Therefore, such a CCD is not suitable as an image 
pickup device of the electronic still camera. As shown in Fig. 29, therefore, a progressive scan system in which charges 
are accumulated for 1/30 second and the charges of all pixels are independently read out without mixing has been 
proposed. According to such a system, although the deterioration in vertical resolution can be prevented, in order to 

20 output an image pickup signal from the image pickup device, a time that Is twice as long as that of the image pickup 
device for the video camera mentioned above is needed on the assumption that the number of pixels Is the same and 
a clock lor reading out is the same. More specifically speaking, an image pickup signal at a period of 1/30 second is 
generated. 

In case of the electronic still camera, in order to focus at the time of photographing or adjust an angle of the camera 

25 upon photographing, a monitor to display a pickup image, for example, a liquid crystal monitor is frequently provided. 
The liquid crystal monitor usually displays a television image by a non-interlace scan of 1/60 second. Therefore, when, 
the image pickup signal at a period of 1/30 second is supplied as it is to the liquid crystal monitor, an image as shown 
in Fig. 30 is derived. To avoid such a phenomenon, as shown in Fig. 31 , for a liquid crystal monitor 62. it is necessary 
to convert a frame rate by a VRAM (video RAM) 61 (or frame memory). An image pickup signal at a period of 1/30 

30 second is supplied to the VRAM 61 and a non-interlace signal at a period of 1/60 second is generated as an output. 

As mentioned above, the image pickup device of the progressive scan type is suitable as an image pickup device 
of the electronic still camera with respect to a point that the vertical resolution is high. However, since the frame rate 
is changed in order to display the image pickup image to an ordinary television monitor there is a problem such that 
a VRAM or a frame memory is necessary and the costs rise. Further, since the electronic still camera has automatic 

35 control apparatuses such as auto focus control apparatus, automatic iris control apparatus, auto white balance control 
apparatus, and the like, there occurs a problem such that since a period of an output signal of the image pickup device 
is long, a response speed of the automatic control is made slow. Further, there is also a problem such that a motion 
of an image which is displayed on the monitor is not smooth. 

As a method of solving the foregoing problems, a data rate of the output signal of the image pickup device is raised, 

40 When a clock frequency is high, however, problems such as increase in electric power consumption, increase in costs 
of parts which are used, deterioration in S/N ratio, and the like occur. Therefore, the method of raising the data rate of 
the image pickup signal is unpreferable. 

One aspect of the invention, provides an image pickup apparatus comprising; 

45 a solid state image pickup device which can operate in a first image pickup mode for performing a reading operation 

of pixels of a first number of lines at a first period and a second image pickup mode for performing a reading 
operation of pixels of a number of lines smaller than the first number of lines at a second period different from the 
first period; 

image signal forming means for forming an image signal from an output signal of the solid state image pickup device; 
50 display means which can display an image signal at a period concerning the second period; 

storing means for storing the image signal; 

switching means for switching a connecting relation among the image signal forming means, the display means, 
and the storing means so as to enable a transfer of the image signal between any two of the image signal forming 
means, the display means, and the storing means; and 
55 control means for setting a first recording mode to control so that the solid state image pickup device operates in 

the first image pickup mode and to control the switching means so as to connect the image signal forming means 
and the storing means when the image signal is stored into the memory means, and, for immediately shifting to a 
second recording mode to control so that the solid state image pickup device operates in the second operating 
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mode and to control the switching nneans so as to connect the image signal forming means and the display means 
when the image signal is stored into the storing means in the first recording mode. 

According to another aspect of the invention, there is also provided an image pickup apparatus comprising: 

5 

a solid state image pickup device which can operate in a first image pickup mode for performing a reading operation 
of pixels of a first number of lines at a first period and a second image pickup mode for performing a reading 
operation of pixels of a number of lines smaller than the first number of lines at a second period different from the 
first period; 

10 image signal forming means for forming an image signal from an output signal of the solid state image pickup device; 

storing means for storing the image signal; 

a coupling terminal which is connected to display means which can display an image signal at a period concerning 
the second period; 

switching means for switching a connecting relation among the image signal forming means, the coupling terminal, 
15 and the storing means so as to enable a transfer of the image signal between any two of the image signal forming 

means, the coupling terminal, and the storing means; and 

control means for setting a first recording mode to control so that the solid state image pickup device operates in 
the first image pickup mode and to control the switching means so as to connect the image signal forming means 
and the storing means when the image signal is stored into the memory means, and, for immediately shifting to a 
20 second recording mode to control so that the solid slate image pickup device operates in the second operating 

mode and to control the switching means so as to connect the image signal forming means and the coupling 
terminal when the image signal is stored into the storing means in the first recording mode. 

According to another aspect of the invention, there is also provided a splid state image pickup device of an interline 
25 system, comprising: 

a plurality of photosensors which are arranged in a matrix form and into which the lights transmitted through a 
plurality of color filters which are repeated in the vertical direction at a period of N (N is a natural number) pixels 
are inputted; 

30 a vertical transfer unit for transferring charges read out from the plurality of photosensors without mixing charges 

from the photosensors continuously arranged in the vertical direction; 

a horizontal transfer unit, coupled to the vertical transfer unit, for generating the charges transferred from the 
vertical transfer unit at one horizontal period: 

a first signal supplying unit in which one unit is constructed by m (m is a natural number) first photosensor groups 
35 which are continuously arranged in the vertical direction and second photosensor groups of the number that is a 

(a Is a natural number) times as large as the pixel period N which are continuously arranged in the vertical direction, 
the first photosensor groups and the second photosensor groups are alternately arranged in the vertical direction, 
and which is used for transferring the charges accumulated in the first photosensor groups to the vertical transfer 
unit; and 

40 a second signal supplying unit for transferring the charges accumulated in the second photosensor groups to the 

vertical transfer unit. 

wherein the first signal supplying unit and the second signal supplying unit are independently provided. 

Embodiments of the invention provide an image pickup apparatus which can output an image pickup signal at a 
45 high speed without losing an advantage such that a vertical resolution is high, thereby making a VRAM unnecessary. 

Further embodiments of the invention provide an image pickup apparatus in which when a pickup image Is recorded 
to a recording medium or when data is read out from the recording medium, a period during which a display of a monitor 
disappears can be minimized. 

Still further embodiments of the invention provide a solid state image pickup device which can output an image 
50 pickup signal at a high speed. 

Embodiments of the invention will now be described, by way of example, with reference to the accompanying 
drawings in which: 

Fig. 1 is a block diagram showing a construction of an embodiment of the invention; 
55 Fig. 2 is a block diagram of an example of a camera signal processing circuit according to the embodiment of the 

invention; 

Fig. 3 is a block diagram of a portion of a multiplexer in the camera signal processing circuit; 
Fig. 4 is a block diagram of an example of the multiplexer; 
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Fig. 5 is a timing chart showing the operation of the multiplexer; 

Fig. 6 is a block diagram showing a connecting relation of a monitoring mode in the embodiment of the invention; 
Fig. 7 is a block diagram showing a connecting relation of a first recording mode in the embodiment of the invention; 
Fig. 8 is a block diagram showing a connecting relation of a second recording mode in the embodiment of the 
s invention: 

Fig. 9 is a block diagram showing a connecting relation of a first reproducing mode in the embodiment of the 
invention; 

Fig. 10 is a block diagram showing a connecting relation of a second reproducing mode in the embodiment of the 
invention; 

10 Fig. 11 is a diagram showing a schematic construction of an example of an image pickup device which can be 

used in embodiments of the invention; 

Fig. 1 2 is an enlarged plan view showing a part of one pixel in an example of the image pickup device; 
Fig. 13 is a schematic diagram showing a structure of a vertical CCD in the example of the image pickup device; 
Fig. 14 is a schematic diagram showing bus wirings of one column in the vertical direction in the example of the 
?5 image pickup device; 

Figs. 15A and 15B are schematic diagrams showing an example and another example of an array of color filters 
which are used in the example of the image pickup device; 

Figs. ISA to 16C are timing charts for driving pulses to drive the example of the image pickup device; 
Fig. 17 is a timing chart for the driving pulses of the Image pickup device in Fig. 14; 
20 Figs. 1 3A to 1 8C are schematic diagrams showing schematically potentials of vertical CCDs in the example of the 

image pickup device; 

Fig. 19 is a schematic diagram showing a specific example of the image pickup device; 

Fig. 20 is a diagram showing bus wirings of one column in the vertical direction of the image pickup device in Fig. 1 9; 

Fig. 21 is a timing chart for driving pulses in the image pickup device in Fig. 19; 
25 Fig. 22 is a schematic diagram showing another specific example of an image pickup device; 

Fig. 23 is a diagram showing bus wirings of one column in the vertical direction of the image pickup device in Fig. 22; 

Fig. 24 is a timing chart for driving pulses of the image pickup device in Fig. 22; 

Fig. 25 is a schematic diagram showing specific further another example of an image pickup device; 

Fig. 26 is a diagram showing bus wirings of one column in the vertical direction of the image pickup device in Fig. 25; 
30 Fig. 27 is a timing chart for driving pulses of the image pickup device in Fig. 25; 

Fig. 28 is a schematic diagram for use in explanation of apreviouslyproposedimage pickup device; 

Fig. 29 is a schematic diagram for use in explanation of apreviously proposedimage pickup device; 

Fig. 30 is a schematic diagram showing a relation between an output of the image pickup device and a display of 

a liquid crystal monitor; and 

35 Fig. 31 is a block diagram showing a construction in case of supplying an image pickup signal generated from the 

image pickup device to the liquid crystal monitor. 

An embodiment of the invention will now be described hereinbelow with reference to the drawings. Fig. 1 shows 
a whole construction of an embodiment of the invention. Reference numeral 101 denotes a solid state image pickup 
40 device such as a CCD. The CCD 1 01 is an imager of a single plate type having three primary color filters, complementary 
color filters, or the like. As will be explained in detail hereinlater, the CCD 101 can switch an operating mode (first image 
pickup mode) of a full-frame reading for reading out charges of all pixels (progressive scan) without nnixing them and 
an operating mode (second image pickup mode) of a line thinning or a line decimation for generating a signal in which 
the number of lines is reduced. The operating modes are switched by controlling a timing generator 108 by a micro- 
ns computer 105. An object light is inputted to the CCD 101 through a lens system 100. 

An output signal of the CCD 101 is supplied to a sample hold and AGC circuit (hereinafter, simply referred to as 
an S/H-AGC circuit) 102. In the full-frame reading mode, a time that is required to read one image is equal to 1/30 
second. In the line thinning mode, it is equal to 1/60 second. Sampling and holding processes are realized by a con- 
struction of a correlated double sampling circuit and an elimination of noises, a waveform shaping, and a compensation 
so of defective pixels are carried out. An AGC process is performed to control a gain in accordance with a brightness of 
an object. A gain is also controlled for an automatic aperture control. An output signal of the S/H-AGC circuit 102 is 
supplied to an A/D converter 103. A digital image pickup signal in which one sample consists of ten bits is generated 
from the A/D converter 103. 

The digital image pickup signal is supplied to a camera signal processing circuit 104 of a construction of an IC 
55 circuit. The signal processing circuit 104 includes: a digital clamping circuit; a luminance signal processing circuit; a 
chrominance signal processing circuit; an outline correcting circuit; a defect compensating circuit; an auto aperture 
control circuit; an auto focus control circuit; an auto white balance correcting circuit; a multiplexer of a component signal 
[digital video signal sampled by a sampling frequency of a ratio of 4 : 1 : 1 (Y: luminance signal, Cr, Cb: color difference 
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signals)]; a sync signal generating circuit; a timing generator; an interface with the microcomputer; and the like. A more 
specific construction of the signal processing circuit 104 will be explained hereinlater. The component signal is con- 
verted to multiplex data by the multiplexer. 

Reference numeral 105 denotes the microcomputer for controlling signal processes. A control signal from the 

5 microcomputer 105 is supplied to the lens system 100. an electronic volume 106; the camera signal processing circuit 
1 04; and a timing controller 1 07. The timing controller 1 07 is constructed by the timing generator 1 08 and a CCD driving 
circuit 109. The electronic volume 106 generates a gain control signal of the S/H-AGC circuit 102. 

A clock 3MCK of a frequency that is three times as high as that of a clock MCK is supplied to the timing generator 
108 of the timing controller 107. The timing generator 108 forms the clock MCK from the clock 3MCK and supplies to 

10 the S/H-AGC circuit 102, A/D converter 103, and camera signal processing circuit 104. The timing generator 108 also 
forms a clock 3/2 MCK of a frequency that is 3/2 times as high as that of the clock MCK from the clock 3MCK and 
supplies to the camera signal processing circuit 104. 

As an example, the number of horizontal pixels of the CCD 1 01 is set to 780 and MCK = 780 fh (fh: horizontal scan 
frequency of the CCD 101) = 12.3 MHz. A horizontal sync signal H and a vertical sync signal V which are generated 

15 from the camera signal processing circuit 104 are supplied to the timing controller 107. Driving pulses generated from 
the CCD driving circuit 109 of the timing controller 107 are supplied to the CCD 101. The driving pulses include a 
vertical driving pulse, a horizontal driving pulse, a read pulse, and the like. 

Fig. 2 shows an example of the camera signal processing circuit 104. In this example, a construction in case of 
including the auto aperture control circuit Is shown. For simplicity of explanation, the defect compensating circuit, auto 

20 focus control circuit, and auto while balance correcting circuit are not shown. A digital image pickup signal of a width 
of 1 0 bits from the A/D converter 1 03 is supplied to an operating circuit 1 1 2 through a digital clamping circuit 111. When 
the CCD has three primary color fitters, an addition or subtraction of three primary color signals is executed by the 
operating circuit 112, so that a luminance signal component and color difference signal components are formed. 

The luminance signal component is supplied to a luminance signal processing circuit 113 and an outline correcting 

25 circuit 114 and the color difference signal components are supplied to a chrominance signal processing circuit 116. A 
gamma (T) correcting circuit and the like are included in the luminance signal processing circuit 113. An outline cor- 
rection signal formed by the outline correcting circuit 11 4 is added to an output signal of the luminance signal processing 
circuit 113 by an adding circuit 115. The luminance signal Y is derived from the adding circuit 115. AT correcting circuit, 
an H VE control circuit, a gain control circuit, and the like are included in the chrominance signal processing circuit 11 6. 

30 The color difference signals Cr and Cb are generated from the chrominance signal processing circuit 116. The com- 
ponent signal comprising Y. Cr, and Cb is supplied to a multiplexer 117. Those signals are synthesized by the multiplexer 
1 17 as will be explained hereinlater and a multiplex component signal is generated as an output of the multiplexer 11 7. 

A timing and sync signal generating circuit 118 is provided. The horizontal sync signal H, vertical sync signal V, a 
clock, and a timing signal are generated from the generating circuit 118 on the basis of the clock MCK. Reference 

35 numeral 1 1 9 denotes a serial I/O for an interface between the microcomputer 1 05 and camera signal processing circuit 
104. Reference numeral 120 denotes a detecting and accumulating circuit. The luminance signal component formed 
by the operating circuit 112 is supplied to the detecting and accumulating circuit 120. In case of an aperture control, 
an image pickup screen is divided into a plurality of regions and the image pickup signal is accumulated every region. 
Accumulation data of each region is outputted from the detecting and accumulating circuit 120 to the serial I/O 119. 

40 The microcomputer 105 receives the accumulation data through the serial I/O 119 and executes a weighting op- 

eration for the accumulation data, an operation to obtain the sum of the weighted data of the respective regions, a 
generation of an aperture control signal, and the like. By the generated aperture control signal, a driving motor of an 
aperture control ring of the lens system 100 is driven and the timing controller 107 and electronic volume 106 are 
controlled. An electronic shutter (exposure time) is controlled by the timing controller 107. A gain is controlled by the 

45 electronic volume 106. A control signal is supplied from the microcomputer 105 to the detecting and accumulating 
circuit 120 through the serial I/O 119 and a dividing pattern or the like of the region is controlled. 

The multiplexer 117 to multiplex the component signal of the (411) system will now be described in more detail. 
As shown in Fig. 3, the multiplexer 117 receives the luminance signal Y and chrominance signal C each having a width 
of eight bits and each of which is synchronized with the clock MCK and generates a multiplexed component signal of 

50 a width of eight bits which is synchronized with the clock 3/2 MCK (clock of a frequency that is 3/2 times as high as 
the clock MCK). Fig. 4 shows a construction of an example of the multiplexer 117. The multiplexer 117 comprises: an 
input selector 121 to select one of the luminance signal Y and chrominance signal C; a shift register 122 to which the 
signal selected by the input selector 121 is supplied as a serial input; a register 123 to which parallel outputs of the 
shift register 1 22 are loaded; an output selector 1 24 to sequentially select the data loaded in the register 1 23; a register 

55 1 25 connected to the output selector 124; a selection pulse forming circuit 126 to form a selection pulse SP1 for 
controlling the input selector 121 from the clock 3/2 MCK; and a selection pulse forming circuit 127 to form a selection 
pulse SP2 for controlling the output selector 124 from the clock 3/2 MCK and clock 1/4 MCK. 
Each register corresponds to data of a width of eight bits. 
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Fig. 5 is a timing chart showing the operation of the multiplexer 117 mentioned above. 3MCK denotes a clock of 
a frequency that is three times as high as the frequency of the clock MCK. Since the luminance data Y and chrominance 
signal C are the component signal of the (411) system synchronized with the clock MCK. red color difference data (for 
example, Cro) of one sample and blue color difference data (for example, Cbo) of one sample correspond to luminance 
5 data (for example. Yq, Y^. Y2. Yg) of four samples. 

The input selector 1 21 is controlled so as to select the luminance data at the high level of the selection pulse SP1 
and to select the chrominance data at the low level thereof. The clock 3/2 MCK is supplied to the shift register 122. 
The shift register 1 22 fetches the data selected by the input selector 121 and serially shifts the fetched data. An output 
Qo of the register at the first stage of the shift register 122 changes like Y.^. Yq, CrQ. Y^, Yg, CbQ. Y3, .... 
10 Outputs of the shift register 122 are loaded into the register 123 in parallel at a timing of the clock 1/4 MCK. A 

period of the clock 1/4 MCK is six times as long as a period of 3/2 MCK. A phase of the clock 1/4 MCK is selected so 
that total six samples of the luminance data and color difference data which are concerned with each other are trans- 
ferred from the shift register 122 to the register 123. 

Fig. 5 shows values of SO, S1, and S5 among values SO to S5 of the registers 123. The selection pulse forming 
15 circuit 126 counts the clock 3/2 MCK by using the clock 1/4 MCK as a trigger, thereby generating the selection pulse 
SP2 having a frequency of 3/2 MCK. 

The output selector 1 24 sequentially selects samples from the register 123 in accordance with the order of Yq, Y^, 
Yg, Y3, Cr, and Cb on the basis of the selection pulse SP2 and the register 1 25 fetches the selected sample. Therefore, 
the multiplexed component signal is generated from the register 125 so as to have the order of (Y, Y, Y, Y, Cr, Cb). 
20 The multiplexer 1 1 7 changes the sampling clock frequency of the data from the frequency of MCK to the frequency 

of 3/2 MCK that is 1.5 times as high as the frequency of MCK, thereby converting into the multiplexed component 
signal having a width of 8 bits. In the case where the multiplexer 117 is not provided and the luminance signal Y and 
chrominance signal C are outputted in parallel, the data (luminance signal Y and chrominance signal C) having a width 
(8x2= 16 bits) is outputted from the camera signal processing circuit 104. In this case, since the number of wirings 
25 is large, crosstalks among the wirings are likely to be generated and an area that is required for the board wirings 
increases. 

Since a width of data of a DRAM 1 41 increases, various problems such as increase in size of DRAM 1 41 , increase 
in electric power consumption of the DRAM 1 41 . and the like occur By providing the multiplexer 1 1 7 on the output side 
of the signal processing circuit 104, the occurrence of those problems can be prevented. 

30 Returning to Fig. 1 , the embodiment of the invention will be further described. The component signal multiplexed 

as mentioned above is supplied from the camera signal processing circuit 1 04 to a data switcher 1 30. The data switcher 
130 has: an output point a connected to the output of the camera signal processing circuit 104; an input point b con- 
nected to a converting circuit 134 for converting the component signal into three primary color signals; and an input/ 
output point c connected to a recording and reproduction data bus 140. A state of the data switcher 130 is controlled 

3S by mode switching signals 131, 132, and 133 generated on the basis of key operations or the like of the user. The 
microcomputer 105 in Fig. 1 is mainly provided for control of a camera unit. Although not shown, a microcomputer is 
provided for each of a control of the recording and reproducing operations and a control of the whole apparatus and 
a communication is performed between those microcomputers. 

Three primary color signals R, G, and B generated by the converting circuit 1 34 are supplied to a television display 

40 apparatus, for example, a liquid crystal display 135. The pickup image is displayed by the liquid crystal display 135. 
The liquid crystal display 1 35 displays a color image by a noninterlace system at a period of 1/60 second. A memory 
which can be accessed at random, for example, the DRAM (Dynamic Random Access Memory) 141 and an encoder/ 
decoder for data compression, for instance, an encoder/decoder 1 42 of JPEG (Joint Photographic Experts Group) are 
connected to the recording and reproduction data bus 140. A high efficient coding of a system other then the JPEG 

•^5 can be also used. A recording medium, for example, a flash memory 143 and an interface (not shown) are connected 
to the encoder/decoder 142. The operation of the DRAM 141 is controlled by an address signal and a control signal 
which are supplied from a memory controller 145. 

The encoder/decoder 142 compresses a data amount into about 1/10 by the JPEG, namely, an adaptive DCT 
(Discrete Cosine Transform). The DRAM 141 is provided for a process of block segmentation or the like in the JPEG. 

50 The flash memory 143 is a semiconductor memory such that the storage contents are held even if a power source is 
turned off and data can be electrically erased and rewritten in a lump every whole memory or every divided region. As 
a recording medium, a medium such as a semiconductor memory or the like other than the flash memory can be also 
used. Further, an interface to supply compressed still image data to a personal computer as necessary can be also 
provided. In an embodiment of the invention, "recording' denotes that the image pickup signal is coded and written 

55 into the flash memory 143 and "reproduction" denotes that the data in the flash memory 143 is read out and the read- 
out data is decoded. 

The foregoing embodiment of the invention will now be described in more detail. In the embodiment, five kinds of 
operations can be performed in accordance with a connecting state of the data switcher 1 30. They are constructed by 
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a monitoring nnode. a first recording mode, a second recording mode, a first reproducing mode, and a second repro- 
ducing mode. Those modes are set by the mode switching signals 131. 132, and 133. The mode switching signals 
131,1 32, and 1 33 are generated from a microcomputer (not shown) for controlling the recording/reproducing system. 
The mode switching signals can be also generated by the microcomputer 105. In the monitoring mode, the image 

5 pickup picture plane is displayed on the liquid crystal display 1 35. In the first recording mode, a desired pickup image 
is written into the DRAM 141. In the second recording mode, the image data stored in the DRAM 141 is compressed 
and written into the flash memory 143. In the first reproducing mode, the data stored in the flash memory 143 is read 
out and the read-out data is decoded and written into the DRAM 141 . In the second reproducing mode, the data in the 
DRAM 141 is read out and displayed on the liquid crystal display 1 35. 

10 Fig. 6 shows a connection of the monitoring mode in which the output point a and input point b of the data switcher 

130 are connected. The monitoring mode is set by making the mode switching signal 131 active. In the monitoring 
mode, the microcomputer 105 controls the CCD driving circuit 109 of the timing controller 107 and makes the CCD 
101 operative in a line thinning mode, which will be explained hereinlater. Lines which are not read out are generated 
from the CCD 101 and the image pickup signal is read out at a period of 1/60 second. 

15 In the monitoring mode, the output signal of the signal processing circuit 104 is supplied to the converting circuit 

134 through the data switcher 130. The three primary color signals which are generated from the converting circuit 
1 34 are supplied to the liquid crystal display 1 35 and displayed. Since the CCD 1 01 operates in the line thinning mode, 
the liquid crystal display 1 35 can perform a nonlnterlace display at a period of 1/60 seconds. By observing the display 
on the LCD 135, an adjustment or the like of an angle of view is executed and a still image to be recorded can be 

20 determined. Although a vertical resolution deteriorates as compared with that upon recording due to the line thinning 
mode, it doesn't cause a problem for an object of monitoring the photographed image. Such a vertical resolution is 
equivalent to that of a conventional CCD camera for performing a field accumulation. 

In the line thinning mode, a trackability for a motion of an object is improved because of a high speed reading. 
Therefore, a response speed of the automatic control such as auto focus control, auto aperture control, or the like is 

25 improved and it is suitable to monitor a motion image. 

In the monitoring mode, the DRAM 141 , encoder/decoder 142, and flash memory 143 which are connected to the 
data bus shown by a broken line are made inoperative. In order to save an electric power consumption, it is desirable 
to turn off the power supply to those inoperative circuits or to stop the supply of the clock that is necessary for the 
operation. In the other modes which will be explained hereinafter as well, a bus for the circuit which is made inoperative 

30 is shown by a broken line and the power supply to the circuit which is made inoperative is turned off in a manner similar 
to the above. 

Fig. 7 shows a connection in a mode in case of recording a still image, namely, in the first recording mode in which 
the output point a and input/output point c of the data switcher 1 30 are connected. The first recording mode is set by 
making the mode switching signal 132 active by a method of pressing a release switch (not shown) or the like. In the 

35 first recording mode, the microcomputer 1 05 controls the CCD driving circuit 1 09 of the timing controller 1 07 and makes 
the CCD 101 operative in the full-frame reading mode. From the CCD 101 . signals of all pixels, for example. 320,000 
pixels are read out without being mixed and the image pickup signal at a period of 1/30 second is read out. 

The image pickup signal is processed by the camera signal processing circuit 104 and is written into the DRAM 
141 through the output point a and input/output point c of the data switcher 1 30 and through the recording and repro- 

40 duction data bus 140. The memory controller 1 45 sets the DRAM 141 into a writing mode and supplies a write address 
to the DRAM 141. The memory controller 1 45 is controlled by a microcomputer (not shown) for controlling the recording/ 
reproducing system. Still image data of one image is written into the DRAM 141 . In the first recording mode in which 
the image data of 1/30 second is written, the image cannot be displayed on the LCD 135. In order to minimize the time 
during which the image is not displayed, when the writing operation is finished, the operating mode is immediately 

45 shifted to the next second recording mode. 

After completion of the writing of the image data of one image into the DRAM 141 , the data switcher 130 is set to 
the second recording mode in which the output point a and input point b are connected as shown in Fig. 8. The second 
recording mode is set by making the mode switching signal 131 active. In the second recording mode, the image data 
is read out from the DRAM 141. The read-out data is supplied to the encoder/decoder 142 through the bus 140. The 

so encoder/decoder 142 compresses the data read out from the DRAM 141 by, for example, the JPEG. The compressed 
data is written into the flash memory 143. As mentioned above, the pickup image is compressed and recorded. 

In the second recording mode, the CCD 101 operates in the line thinning mode. In a manner similar to the monitoring 
mode, the signal read out from the CCD 101 is processed at a high speed by the camera signal processing circuit 104. 
The image signal is supplied to the LCD 135 through the data switcher 130 and converting circuit 134 and the image 

55 is displayed. Thus, a time which is required until the display of the image is deleted from the LCD 135 upon recording 
can be minimized. 

In the reproducing mode, the image data written in the flash memory 1 43 is reproduced and displayed by the LCD 
1 35. Fig. 9 shows a state of the first reproducing mode in which the output point a and input point b of the data switcher 
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130 are connected and the image pickup signal is displayed on the LCD 135. The first reproducing nnode is set by 
nnaking the nnode switching signal 131 active by a method of depressing a playback button (not shown) by the user or 
the like. In this mode, the data is read out from the flash memory 143 and the read data is supplied to the encoder/ 
decoder 142. 

5 The data is decoded by the encoder/decoder 142 and the image data is generated. The DRAM 141 is controlled 

so as to write the image data. In this case, the memory controller 145 controls the write address in the DRAM 141 so 
that the decoding data is written into the DRAM 141 in the same data array with that in the first recording mode. A 
similar data array can be also realized by an address control upon reading. The above relation is necessary to use the 
same circuit as that which is used in the monitoring mode in case of supplying the digital Image signal read out from 

10 the DRAM 141 to the LCD 135 through the converting circuit 134 and displaying by the LCD 135. In the first reproducing 
mode, the CCD 101 is driven in the line thinning mode and the image pickup image of the CCD 101 is displayed on 
the LCD 135. 

When the decoding data is written into the DRAM 141, the second reproducing mode shown in Fig. 10 is imme- 
diately automatically set. In the second reproducing mode, the input/output point c and input point b of the data switcher 
1 30 are connected. The second reproducing mode is set by making the mode switching signal 1 33 active. The DRAM 
1 41 is set into the reading mode. The data read out from the DRAM 1 41 is supplied to the LCD 1 35 through the recording 
and reproduction data bus 140, data switcher 130, and converting circuit 134. Therefore, the image corresponding to 
the data recorded in the flash memory 143 can be seen by the LCD 135. In this case, the data recorded in the flash 
memory 143 is not the line thinning data but the full-frame data. Therefore, a line thinning similar to the case where 
20 the CCD 101 is driven in the line thinning mode is realized by the address control by the memory controller 145. Namely, 
only the data of every other line is read out. Thus, the read-out data from the DRAM 141 can be reproduced by the 
LCD 135. 

In this manner, the still image data stored in the flash memory 143 can be reproduced and seen by the LCD 135. 
The number of still images which can be recorded is determined in dependence on a memory capacity of the flash 

25 memory 1 43, a data compressing method, or the like. As for a flash memory 1 43. it is preferable to use a construction 
of a detachable IC card. A recording medium other than the flash memory can be also used. Further, it is also possible 
to transmit the recording data to an external personal computer through an interface provided as necessary or to store 
the recording data into an external storage device. 

An example of the CCD 101 will now be described hereinbelow. Fig. 11 schematically shows an example of a CCD 

30 1 . In this example, the CCD 1 uses an interline system and has: photosensors (for example, photodiodes) 2 which are 
two-dimensionally arranged in an image area; vertical CCDs (vertical transfer unit) 3, arranged among the photosensors 
2, for transferring signal charges from the photosensors 2 to a horizontal CCD (horizontal transfer unit) 4; and a buffer 
amplifier 5 connected to the horizontal CCD 4. The image pickup light transmitted through color filters with an array 
as will be explained hereinlater enters the photosensors 2. One photosensor 2 corresponds to one bit in the vertical 

35 CCD 3. The signal charges from the photosensors 2 can be read out to the vertical CCDs 3 without mixing. The signals 
of all pixels can be sequentially transferred to the horizontal CCD 4 without mixing. By driving the horizontal CCD 4. 
the signal is transferred into the buffer amplifier 5 as a floating diffusion area and is sequentially converted into a voltage 
and outputted. 

Fig. 1 2 shows a plan view of a unit pixel of the CCD 1 . Fig. 1 3 shows a structure of the vertical CCD 3. The vertical 

40 CCD 3 has a structure of, for example, the 3-layer electrode and 3-phase driving. In Fig. 12, reference numeral 6 
denotes a transfer channel of the vertical CCD 3; 7 a channel stopper for separating among the pixels and among the 
pixels and the transfer channel; and 8, 9, and 10 transfer gates of the vertical CCDs 3, respectively. The transfer gate 
9 is commonly used as a read gate. In Fig. 12. a light shielding film and the like are omitted and are not shown. As 
shown in Fig. 13. the transfer gates 8. 9, and 10 are formed by working first, second, and third polycrystalline silicon 

45 electrodes. Vertical driving pulses ^V^, ^Vg, and (pV^ are respectively supplied to the transfer gates 8, 9. and 10. 

When the signals are read out from the photosensors 2 to the vertical CCDs 3, a bias voltage (referred to as a 
read pulse) at a level higher than the high level of the vertical transfer clock (^Vg is applied to the transfer gate adjacent 
to the photosensors 2, namely, the transfer gate 9 also serving as a read gate. When the read pulse is supplied to the 
gate 9, since one pixel corresponds to one bit of the vertical CCD 3. the signal charges from all of the photosensors 2 

50 are read out to the vertical CCDs 3. The horizontal CCD 4 generates the data of one line by transfer clocks ^H^ and 
<J)H2. For instance, a CCD with a compound channel horizontal CCD structure can be used as a horizontal CCD 4. In 
this case, an output unit has a construction of two channels. 

Since the above CCD can sequentially generate the signals of all pixels without mixing, it is suitable for an electronic 
still camera and an image fetching. However, as compared with an image pickup device for a video camera having the 

55 same number of pixels for performing an interlace output, when the charges are transferred by the same clock, an 
output time of one picture plane (from the top to the bottom of the screen) is doubled. In this example, as mentioned 
above, as a signal for monitoring and an image pickup signal for the automatic control such as an auto focus control 
and the like, by reducing the number of horizontal lines, the image pickup signal of one picture plane is outputted at a 
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high speed and. in case of the line thinning, a situation such that a color sequence in the vertical direction which is 
specified by the array of the color filters is broken is prevented. On the other hand, in case of fetching the photographed 
image into the flash nnennorv. the image pickup signal of the full-frame (image pickup signal in which the number of 
lines is not thinned or decimated) is generated. Even in case of the line thinning, since the color sequence is the same 

5 as the case of the full frame, a problem such that the signal processing circuit is complicated can be avoided. 

In the CCD which can read out all pixels mentioned above, the thinning of the number of lines can be realized by 
dividing the wirings for the transfer gate (the second polycrystalline silicon) 9 which contributes to the reading of the 
signal charges from the photosensors 2 into two portions. A repetitive period of the colors is shown by N. Fig. 1 4 shows 
an example in case of (N = 2) in which one period is formed by two upper and lower pixels. 

10 As an array of color filters of the CCD of the single plate type, a structure such that R (filter for transmitting red). 

G (filter for transmitting green), and B (filter for transmitting blue) are arranged (Bayer system) as shown in Fig.lSA 
has been proposed. The filter of G of a high sensitivity is arranged for the pixels of the half of the whole pixels. Color 
filters of a complementary color checkerwise array shown in Fig. 15B have also been proposed. In Fig. 15B, Ye, Cy, 
and Mg denote filters of yellow, cyan, and magenta, respectively. The complementary color filters shown in Fig. 15B 

15 are often used in a video camera because a resolution can be raised as compared with the primary color filters. On 
the other hand, the primary color filters shown in Fig. 15A are excellent in terms of the color reproducibility and are 
frequently used in an electronic still camera. 

As an image pickup device in embodiments of the invention, any one of the single plate type image pickup device 
having the primary color filters and the single plate type image pickup device having the complementary color filters 

20 can be used. Further, although not shown, it is also possible to use an image pickup device (what is called a spatial 
picture deviating system) of a system which is constructed by an image pickup device having the filter of G and the 
image pickup device having an array of the filters of R and B and in which the two image pickup devices have a positional 
relation such that they are deviated by only 1/2 of a pixel pitch in the horizontal and vertical directions. 

In the array of Fig. 1 5A, the repetitive period N of the colors in the vertical direction is equal to (N = 2). In the array 

25 of Fig. 15B, (N = 4). Fig. 14 is a schematic diagram in case of (N = 2) and shows the photosensors 2 of one column 
in the vertical direction, vertical CCDs 3, and bus wirings of the gates of the vertical CCDs 3 with respect to a part of 
one column. Among the photosensors 2, the photosensor in which a hatched portion is provided in the left upper corner 
corresponds to one color filter, for example, filter of G and the photosensor without a hatched portion corresponds to 
the other color filter, for instance, filter of B. As mentioned above, the vertical CCD 3 is of the type of the 3-layer electrode 

30 and 3-phase driving and has gates of three bits so as to be neighboring to opening pixels (pixels which are not shielded 
against the light) of the CCD. The vertical CCD 3 includes a first region A and a second region B. The first region A 
comprises gates 21 . 22. and 23 and the second region B comprises gates 31 . 32. and 33. The gates 22 and 32 are 
read gates also serving as transfer gates. Reference numerals 41. 42. 42', and 43 denote bus wirings to which the 
driving pulses (t)V-,, iJiVg. (t>V2', and (t)\/3 for vertical transfer are supplied, respectively. 

35 The gates 21 and 31 are connected to the bus wiring 41 and the gates 23 and 33 are connected to the bus wiring 

43. The driving pulses and (^V^^ are supplied to the bus wirings 41 and 43. respectively. With respect to the driving 
pulse (t)V2, two buses 42 and 42' are provided. The first region A indicates a region in which the transfer and read gate 
22 is connected to the bus 42. The second region B indicates a region in which the transfer and read gate 32 is 
connected to the bus 42'. In Fig. 1 4. for simplicity of drawing, although only one side of the bus lines is drawn, generally, 

40 the bus lines are arranged on both sides of the photosensor 2 and both sides are driven. 

In the above image pickup device, a range in which m (m = 1 , 2, 3, ...) first regions A are arranged and a range in 
which (N X a) second regions B are arranged are alternately formed in the vertical direction for the purpose of line 
thinning. The example shown in Fig. 14 relates to a case of (N = 2, m = 3, a = 2). Although values of m and a can 
arbitrarily selected, even if m and a are set to large values, it is necessary that (m + N x a) is smaller than the number 

45 of vertical pixels among the number of effective pixels. 

In the foregoing image pickup device, in the first operating mode, namely, at the time of the full-frame operation 
to read out the signals of all pixels, the signals are read out from the photosensors 2 to both of the first region A and 
second region B of the vertical CCD 3. For this purpose, the read pulses are supplied to both of the gales 22 and 32 
through the bus wirings 42 and 42'. In this case, the chrominance signals are generated by a color sequence corre- 

50 sponding to the order of the array of the color filters, for example, by the sequence of G, B. G, B, .... 

In the second operating mode, namely, at the time of the line thinning operation, on the other hand, the read pulses 
are supplied to only the gate 22 of the first region A through the bus wiring 42. Therefore, the signals are read out from 
the range of m and the signals are not read out from the range of N x a. In the example of Fig. 14, the signals are 
generated from (m = 3) lines and no signal is generated from (N x a = 4) lines. Since the number of lines to be thinned 

55 is integer times as large as the repetitive period N of the colors, the order of the chrominance signals of the image 
pickup output in case of the tine thinning is held in the same relation as that in the full-frame reading operation. 

Figs. 16A to 160 show timings in case of driving the image pickup device. Fig. 16A shows the timing in case of 
performing the full-frame reading, in each horizontal blanking period, the 3-phase driving pulses (t>Vi. 0V2. (tJVa'. and 
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<^V^ as line shift pulses LS are supplied to the gates 21 , 22. and 23 of the first region A and to the gates 31 . 32, and 
33 of the second region B of the vertical CCD 3. respectively. The read pulse is also supplied to both of the gates 22 
and 32 every 1 V. By the read pulse, the signal charges fronn all of the photosensors are read out to the vertical CCDs 
3. As shown in a detailed tinning chart of Fig. 1 SB, the driving pulses f^V^ , <^\/2, ^Vg'. and f^V^ which are generated within 

5 the horizontal blanking period are the pulses of three phases and a shift of charges of one line is carried out for one 
line shift period. At the tinne of the full-frame reading, a shift of one line is executed in each horizontal blanking period. 

On the other hand, in case of the line thinning reading, as shown in Fig. 16C, the read pulse is applied to only the 
gate 22 of the first region A. Thus, the signal charges are read out from only the photosensors adjacent to the first 
region A. In case of the line thinning, the signal charges are not read out to the vertical CCDs 3 of the thinned lines 

10 and no signal is generated. Such a no-signal period can be eliminated by repeating the line shifting operation a plurality 
of number of times. 

For example^ in case of the color array shown in Fig. 14, the charges of three pixels shown by HI, specifically 
speaking, the signal charges of one first region A and the no-signal of the two second regions B are synthesized in the 
horizontal CCD 4 by supplying the line shift pulse LS three times in a first horizontal period HI as shown in Fig. 17. 

^5 Similarly, by supplying the line shift pulse LS three times in a second horizontal period H2. the signal charges of one 
first region A and the no-signal of the two second regions 8 are synthesized in the horizontal CCD 4. By supplying the 
line shift pulse LS once in a third horizontal period H3, the signal charges of one first region A are supplied to the 
horizontal CCD 4 in one horizontal period. Therefore, in each horizontal period, the signal charges from one first region 
are outputted without changing the color sequence. The operation in the period shown in Fig. 17 is repeated every 

20 three horizontal periods. 

Fig. ISA is a schematic diagram of a potential of the channel 6 of the vertical CCD 3 in case of (m = 1 , a = 1 ). The 
direction directing from the right side to the horizontal CCD 4 on the left side facing the drawing is set to the vertical 
transfer direction. At the time of the line thinning operation, a packet 51 including signal charges Qs and an empty 
packet 52 exist in the channel 6. To output the signal charges Qs from each line, a line shift is executed a number of 

25 times larger by the time corresponding to the empty packets 52, thereby mixing the signal charges and no-signal In 
the horizontal CCD 4 and eliminating the period of no-signal. It is sufficient that the number of times of line shift which 
is executed in each horizontal blanking period is set so as to satisfy the following relation. 

> 1 [the number of packets including the signal 
charges Qs to be outputted (in this example, 
considered as one packet)] -»- 
X (the number of packets which exist at 
preceding positions and don't include the 
signal charges Qs) 

< 1 -I- X + (N X a) (the number of packets which exist 
behind and don't include the signal charges 
Qs) 

Thus, in case of (X - 0), only the signal charges are transferred to the horizontal CCD 4. In case of (X ^ 0), the 
50 packets including the signal charges and one or more packets which don't include the signal charges are transferred 
to the horizontal CCD 4. 

By the above conditions, the signal charges can be transferred to the horizontal CCD 4 and the lines of no-signal 
can be compressed. Actually, the charges of the empty packet are not equal to 0 and unnecessary signal charges Qn 
such as smear signal, dark current, and the like are includes. When the number of times of line shift which is executed 
55 in each horizontal blanking period is different, since the number of times of addition of the unnecessary signal charges 
Qn is different, an amount of unnecessary signals included differs depending on the tines as an actual output. There 
Is. consequently, a fear such that a line crawl phenomenon in which a luminance is variably seen every line on the 
monitor or a deterioration in picture quality such as a color deviation or the like occurs. 



10 



BNSDOCID: <EP 0794662A2J_> 



# m 

EP 0 794 662 A2 

To solve such a problem, it is sufficient to set the number of times of line shift which are executed in each horizontal 
blanking period to a constant value. In case of a limited condition, namely, when (m = 1 or m = 2). by setting the number 
of times of line shift of the vertical CCD 3 to [(N x a/m) + 1], the number of packets which don't include the signal 
charges Qs which are added to the signal charges Qs of each line can be made constant. Thus, the occurrence of the 

5 deterioration of the picture quality mentioned above can be prevented. 

Fig. 18B is a schematic diagram of the potential of the channel 6 of the vertical CCD 3 in case of (N = 2. m = 1 , a 
= 1). In this example, (N x a/m = 2) and by setting the number of times of line shift to 3, the number of packets which 
don't include the signal charges Qs which are added in each line serving as an actual output can be made constant. 
Fig. 1 8C shows a case of (N = 2, m = 2, a = 1 ). In this case. (N x a/m = 1 ) and It is sufficient to set the number of times 

10 of line shift to 2. Further, even in case of m > 2. if the level of the smear signal or dark current can be sufficiently 
reduced, no problem occurs. 

In the foregoing CCD image pickup device, since the number of lines serving as an actual output can be reduced, 
by selecting the value of m of the first regions A arranged and the value of (N x a) of second regions B arranged of the 
vertical CCD 3. the number of lines of the output image pickup signal can be suppressed to a value that is equal to or 
IS less than the number of horizontal scanning lines of a television of one field. Several examples of the number of output 
lines will now be described with respect to a case such as a color filter array (N = 2) of the Bayer system. 

As shown in Fig. 19, in case of applying the invention to an image pickup device corresponding to VGA (Video 
Graphics Array) in which the number of effective pixels (vertical pixels x horizontal pixels) is equal to (480 x 640), (a 
= 1 , m = 2). In the line thinning mode, therefore, the number of output lines can be reduced to the half value, namely 
20 240 lines. 

Fig. 20 shows a structure of a vertical CCD of one column in the vertical direction in case of the image pickup 
device shown in Fig. 19. Fig. 21 shows a timing chart for driving pulses for driving the image pickup device shown in 
Fig. 20 in the second operating mode. Portions corresponding to those in Fig. 14 are designated by the same reference 
numerals and their descriptions are omitted here. In this case, in each horizontal period, the line shift pulse LS Is 

25 supplied twice. In the second operating mode, the signal of only R is read out in the first horizontal period HI and the 
signal of only G is read out in the second horizontal period H2. In the example shown In Fig. 20. since the number of 
lines which are added In each horizontal period is equal, the problem of the color deviation and the like don't occur. 

As shown in Fig. 22, In an image pickup device in which the number of effective pixels is equal to (768 x 1024), 
by setting (m = 1 , a = 1 ), the number of output lines can be set to 256. 

30 Fig. 23 shows a structure of a vertical CCD of one column in the vertical direction in case of the image pickup 

device shown in Fig. 22. Fig. 24 shows a timing chart for driving pulses to drive the image pickup device shown in Fig. 
23 in the second operating mode. Portions corresponding to those in Fig. 14 are designated by the same reference 
numerals and their descriptions are omitted here. In this case, in each horizontal period, the line shift pulse LS Is 
supplied three times. In the second operating mode, the signal of only R is read out for the first horizontal period H1 

3S and the signal of only G is read out for the second horizontal period H2. It is also possible to read out the signal of only 
R for a first horizontal period HI' and to read out the signal of only G for a second horizontal period H2'. In the example 
shown in Fig. 23, since the number of lines which are added in each horizontal period is equal, the problems such as 
a color deviation and the like don't occur. 

As shown in Fig. 25. in an Image pickup device in which the number of effective pixels is equal to (1024 x 1280), 

40 by setting (m = 1 , a^ = 1 . 32 = 2), the number of output lines can be set to 256. a^ and 82 are alternately used. 

Fig. 26 shows a structure of a vertical CCD of one column In the vertical direction of the image pickup device shown 
in Fig. 25. Fig. 27 shows a timing chart for driving pulses to drive the image pickup device shown in Fig. 26 in the 
second operating mode. Portions corresponding to those in Fig. 14 are designated by the same reference numerals 
and their descriptions are omitted here. In this case, the line shift pulse LS is supplied four times In each horizontal 

45 period. In the second operating mode, the signal of only R Is read out for the first horizontal period HI and the signal 
of only G is read out for the second horizontal period H2. It is also possible to read out the signal of only R for the first 
horizontal period HV and to read out the signal of only G for the second horizontal period H2'. It is also possible to 
read oul the signal of only R for a first horizontal period HI " and to read out the signal of only G for a second horizontal 
period H2". In the example shown in Fig. 26, since the number of lines which are added in each horizontal period is 

so equal, the problems of the color deviation and the line don't occur. 

In any cases shown in Figs. 1 9. 22, and 25, the number of output lines can be reduced less than, for example, the 
number of lines (262.5) of one field of the NTSC system. Therefore, the color sequence and the angle of view can be 
held In the same relation as that in the full-frame reading mode and the image pickup signal in the line thinning mode 
can be generated In a shorter time. Thus, the image pickup picture plane can be displayed on the liquid crystal monitor 

ss without using a VRAM or frame memory. 

The foregoing specific construction of the image pickup device in the embodiment has been shown as an example 
and the invention can also use another solid state image pickup device. For instance, the vertical CCD can also have 
a structure of the 2-layer electrode and 4-phase driving. 
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Further, as a mode to drive the solid state image pickup device, it is also possible to set a third operating mode in 
which the read pulse (j^Vg is applied and the read pulse ^^V2 is not applied. 

In embodiments of the invention as described above, a still image of a good vertical resolution can be obtained in 
the full-frame image pickup mode for the progressive scan and, in case of use for a display of the liquid crystal display 
5 or the like, the image pickup signal can be generated at a high speed in the line thinning image pickup mode. Therefore, 
the image pickup signal can be displayed on the monitor without providing a VRAM. Since the image pickup signal 
can be generated at a high speed, a response speed of the automatic control apparatus such as an auto focus or the 
like can be raised. Further, since the number of frames is large, there is an advantage such that a motion of the monitor 
image is smoothed. 

10 In embodiments of the invention, upon recording, since the image pickup signal is displayed in a period of time 

other than the period for writing the image signal into the memory (DRAM), the period of time during which the display 
is deleted from the display screen can be minimized. Moreover, in the reproduction, since the image pickup signal is 
supplied to the display device for a period of time during which the data is read out from the recording medium, the 
period of time during which the display is deleted can be minimized in a manner similar to the case of recording. 

?5 In addition, in embodiments of the invention, by variably setting the clock frequency, the component signal that is 

generated from the camera signal processing circuit can be multiplexed and a bit width of the data bus arranged for 
the signal processes at the post stage can be reduced. Thus, the signal deterioration due to crosstalks or the like can 
be suppressed. 

In embodiments of the invention, the full-frame operating mode of the progressive scan and the angle of view and 
20 color sequence are held in the same relation and the image pickup signal of a small number of lines can be selectively 
derived and the image pickup signal can be outputted at a high speed. Therefore, even in an image pickup device of 
a large number of lines, the number of output lines can be reduced to a value that is equal to or less than the number 
of scanning lines of the television. The image pickup signal can be displayed on the monitor without using a memory 
of a large capacity such as frame memory, VRAM, or the like. Since the image pickup signal can be outputted at a high 
25 speed, a response speed of the automatic control apparatus such as an auto focus or the like can be raised. Further, 
since the number of frames is large, there is an advantage such that the motion of the monitor image is smoothed. 

Although preferred embodiments of the invention have been described, modifications and variations are possible 
within the scope of the invention. 

30 

Claims 

1. An image pickup apparatus comprising: 

35 a solid state image pickup device which can operate in a first image pickup mode for performing a reading 

operation of pixels of a first number of lines at a first period and a second image pickup mode for performing 
a reading operation of pixels of a number of lines smaller than said first number of lines at a second period 
different from said first period; 

image signal forming means for forming an image signal from an output signal of said solid state image pickup 
40 device; 

display means which can display an image signal at a period concerning said second period; 
storing means for storing said image signal; 

switching means for switching a connecting relation among said image signal forming means, said display 
means, and said storing means so as to enable a transfer of said image signal between any two of said image 

•^5 signal forming means, said display means, and said storing means; and 

control means for setting a first recording mode to control so that said solid state Image pickup device operates 
in said first image pickup mode and to control said switching means so as to connect said image signal forming 
means and said storing means when said image signal is stored into said memory means, and, for immediately 
shifting to a second recording mode to control so that said solid state image pickup device operates in said 

50 second operating mode and to control said switching means so as to connect said image signal forming means 

and said display means when said image signal is stored into said storing means in said first recording mode. 

2. An apparatus according to claim 1. further comprising: 

55 compressing means for compressing a data amount of said image signal to form a compressed image signal; 

and 

recording means for recording said compressed image signal. 
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An apparatus according to claim 2. wherein in said second recording mode, said control means supplies the image 
signal stored in said storing means to said compressing means and allows said image signal to be compressed 
and allows said compressed image signal to be recorded to said recording means. 

An apparatus according to claim 3, wherein said recording means records said compressed image signal onto a 
detachable recording medium. 

An apparatus according to claim 2, wherein said control means sets a first reproducing mode to control said solid 
state image pickup device so as to operate in said second image pickup mode, to control said switching means 
so as to connect said storing means and said display means, to decompress the compressed Image signal read 
out from said recording means by said compressing means, to set the decompressed image signal to said image 
signal, and to store said image signal into said storing means when said compressed image signal is read from 
said recording means and, immediately shifts to a second reproducing mode to control said switching means so 
as to connect said storing means and said display means when said image signal is stored in said storing means 
in said first reproducing mode. 

An apparatus according to claim 5, wherein in said second reproducing mode, said control means thinnes the 
image signal stored in said storing means and reads out the thinned image signal. 

An apparatus according to claim 1, wherein said image signal forming means includes: 

luminance signal forming means for forming a digital luminance signal of a first clock rate of a first bit width 
from the output signal of said solid state image pickup device; 

chrominance signal forming means for forming a digital chrominance signal of a clock rate of 1/2 of said first 
clock rate of said first bit width from the output signal of said solid state image pickup device; and - 
a multiplexer for multiplexing said digital luminance signal and said digital chrominance signal and generating 
the multiplexed signal on the basis of a clock rate which is 3/2 times as high as said first clock rate. 

An apparatus according to claim 7, wherein said digital chrominance signal is a signal in which a first digital color 
difference signal and a second digital color difference signal are multiplexed. 

An image pickup apparatus comprising: 

a solid state image pickup device which can operate in a first image pickup mode for performing a reading 
operation of pixels of a first number of lines at a first period and a second image pickup mode for performing 
a reading operation of pixels of a number of lines smaller than said first number of lines at a second period 
different from said first period; 

image signal forming means for forming an image signal from an output signal of said solid state image pickup 
device; 

storing means for storing the image signal; 

a coupling terminal which is connected to display means which can display an image signal at a period con- 
cerning said second period; 

switching means for switching a connecting relation among said image signal forming means, said coupling 
terminal, and said storing means so as to enable a transfer of said image signal between any two of said image 
signal forming means, said coupling terminal, and said storing means; and 

control means tor setting a first recording mode to control so that said solid state image pickup device operates 
in said first image pickup mode and to control said switching means so as to connect said image signal forming 
means and said storing means when said image signal is stored into said memory means, and, for immediately 
shifting to a second recording mode to control so that said solid state image pickup device operates in said 
second operating mode and to control said switching means so as to connect said image signal forming means 
and said coupling terminal when said image signal is stored into said storing means in said first recording mode. 

I. An apparatus according to claim 9, further comprising: 

compressing means for compressing a data amount of said image signal to form a compressed image signal; 
and 

recording means for recording said compressed image signal. 
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11. An apparatus according to claim 10. wherein in said second recording mode, said control means supplies the 
image signal stored in said storing means to said compressing means and allows said image signal to be com- 
pressed and allows said compressed image signal to be recorded to said recording means. 

5 1 2. An apparatus according to claim 11 , wherein said recording means records said compressed image signal onto a 
detachable recording medium. 

1 3. An apparatus according to claim 1 0, wherein said control means sets a first reproducing mode to control said solid 
state image pickup device so as to operate in said second image pickup mode to control said switching means so 

10 as to connect said storing means and said connecting terminal, to decompress the compressed image signal read 

out from said recording means by said compressing means, to set the decompressed image signal to said image 
signal, and to store said image signal into said storing means and, when said compressed image signal is read 
from said recording means, immediately shifts to a second reproducing mode to control said switching means so 
as to connect said storing means and said connecting terminal when said image signal is stored in said storing 

'5 means in said first reproducing mode. 

14. An apparatus according to claim 13, wherein in said second reproducing mode, said control means thinnes the 
image signal stored in said storing means and reads out the thinned image signal. 

20 15, An apparatus according to claim 9, wherein said image signal forming means includes: 

luminance signal forming means for forming a digital luminance signal of a first clock rate of a first bit width 
from the output signal of said solid state image pickup device; 

chrominance signal forming means for forming a digital chrominance signal of a clock rate of 1/2 of said first 
2S clock rat© of said first bit width from the output signal of said solid state image pickup device; and 

a multiplexer for multiplexing said digital luminance signal and said digital chrominance signal and generating 
the multiplexed signal on the basis of a clock rate which is 3/2 times as high as said first clock rate. 

16. An apparatus according to claim 15. wherein said digital chrominance signal is a signal in which a first digital color 
30 difference signal and a second digital color difference signal are multiplexed. 

17. A solid state image pickup device of an interline system, comprising: 

a plurality of photosensors which are arranged in a matrix form and into which the lights transmitted through 
35 a plurality of color filters which are repeated in the vertical direction at a period of N (N is a natural number) 

pixels are inputted; 

a vertical transfer unit for transferring charges read out from said plurality of photosensors without mixing 
charges from said photosensors continuously arranged in the vertical direction; 

a horizontal transfer unit, coupled to said vertical transfer unit, for generating the charges transferred from 

40 said vertical transfer unit at one horizontal period; 

a first signal supplying unit in which one unit is constructed by m (m is a natural number) first photosensor 
groups which are continuously arranged in the vertical direction and second photosensor groups of the number 
that is a (a is a natural number) times as large as said pixel period N which are continuously arranged in the 
vertical direction, said first photosensor groups and said second photosensor groups are alternately arranged 

45 in the vertical direction, and which is used for transferring the charges accumulated in said first photosensor 

groups to said vertical transfer unit; and 

a second signal supplying unit for transferring the charges accumulated in said second photosensor groups 
to said vertical transfer unit, 

wherein said first signal supplying unit and said second signal supplying unit are independently provided. 

50 

18. A device according to claim 1 7, further having driving signal forming means for forming driving signals which are 
inputted to said first and second signal supplying units and drive said vertical transfer unit and said horizontal 
transfer unit. 

and wherein said driving signal forming means forms a line shift signal as said driving signal to transfer said 
55 charges from said vertical transfer unit to said horizontal transfer unit for a horizontal blanking period. 

19. A device according to claim 18. wherein said driving signal forming means can selectively switch 
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a first operating mode to read out the charges of all pixels by supplying the driving signals to said first and 
second signal supplying units and 

a second operating mode to form the driving signal to drive only said first signal supplying unit. 

5 20. A device according to claim 18, wherein said driving signal forming means forms said line shift signal (m + N * a) 
times as a whole for m continuous horizontal blanking periods so that the charges of (m + N * a) lines are generated 
for m horizontal periods. 

21 - A device according to claim 1 8, wherein when one pixel included in a certain first photosensor group is considered 
10 as a first pixel, said driving signal forming means forms the line shift signal in a manner such that the charges of 

a second pixel which is included in said certain first photosensor group and is adjacent to said first pixel in an upper 
or lower direction and the charges of said first pixel are transferred from said vertical transfer unit to said horizontal 
transfer unit for different horizontal blanking periods, respectively. 

15 22. A device according to claim 21 , wherein when a pixel which is included in said certain first photosensor group and 
is adjacent to said first pixel in the upper direction is set to said second pixel and a pixel which is adjacent to said 
first pixel in the lower direction is set to a third pixel, 

between said second and third pixels, with respect to the pixel in which a physical distance from said first 
pixel is longer, in a manner such that the charges of said pixel of the longer physical distance and the pixels locating 

20 between said pixel and said first pixel are added to the charges of said first pixel or said pixel of said longer physical 

distance, said driving signal forming means forms at least two line shift signals for a horizontal blanking period 
during which the charges of said pixel of the longer physical distance are transferred from said vertical transfer 
unit to said horizontal transfer unit. 

25 23. A device according to claim 18, wherein said driving signal forming means forms the same number of line shift 
signals for each horizontal period. 

24, A device according to claim 17, wherein said N differs on each unit basis. 

30 25, A device according to claim 17. wherein said N is equal to a 2-unit period and is set in accordance with the order 
of 2 and 4 every unit. 

26. A device according to claim 17, wherein said N is fixed to 2 in any unit. 

35 27. A device according to claim 18. wherein when m = 1 or 2, 

said driving signal forming means forms [(N * a/m) + 1] line shift signals for each horizontal blanking period, 
so that the charges of the pixels of one line including the signal charges and the charges of the pixels of (N * 
a/m) lines which doni include the signal charges are mixed in said horizontal transfer unit. 

40 
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